Computational Polarization: An Information-Theoretic Method for Resilient Computing

Information-Theoretic Computational Complexity

This paper attempts to describe, in nontechnical language, some of the concepts and methods of one school of thought regarding computational complexity. It applies the viewpoint of information theory to computers. This will first lead us to a definition of the degree of randomness of individual binary strings, and then to an information-theoretic version of Gödel's theorem on the limitations of...

An Elementary Method for Computing the Kostka Coefficients

An Information-Theoretic Discussion of Convolutional Bottleneck Features for Robust Speech Recognition

Convolutional Neural Networks (CNNs) have been shown their performance in speech recognition systems for extracting features, and also acoustic modeling. In addition, CNNs have been used for robust speech recognition and competitive results have been reported. Convolutive Bottleneck Network (CBN) is a kind of CNNs which has a bottleneck layer among its fully connected layers. The bottleneck fea...

Application of an information-theoretic method for efficacy assessment.

An information-theoretic pattern recognition method was used to construct descriptive models of data related to 1,674 radioisotope lung scan referrals for the purpose of assessing lung scan influence on diagnosis and management of pulmonary embolism. It was observed that, relative to other clinical information available prior to the scan, the lung scan significantly improved the ability of the ...

An information theoretic method for designing multiresolution principal component transforms

Principal Component Analysis (PCA) is concerned basically with finding an optimal way to represent a random vector through a linear combination of a few uncorrelated random variables. In signal processing, multiresolution transforms are used to decompose a time signal into components of different resolutions. In this paper, we consider designing optimal multiresolution transforms such that comp...